The Azure MCP Server implements the MCP specification to create a seamless connection between AI agents and Azure services. It allows agents to interact with various Azure services like AI Search, App Configuration, Cosmos DB, and more.
The article discusses the increasing complexity of Kubernetes and suggests that Silicon Valley is exploring alternative technologies for container orchestration, citing a benchmark showing a stripped-down stack outperforming Kubernetes.
Kagent is an open-source agentic AI framework for Kubernetes that aims to provide autonomous problem solving and remediation for cloud-native infrastructure, moving beyond traditional automation to a more intelligent and self-healing system.
Running GenAI models is easy. Scaling them to thousands of users, not so much. This guide details avenues for scaling AI workloads from proofs of concept to production-ready deployments, covering API integration, on-prem deployment considerations, hardware requirements, and tools like vLLM and Nvidia NIMs.
K8S-native cluster-wide deployment for vLLM. Provides a reference implementation for building an inference stack on top of vLLM, enabling scaling, monitoring, request routing, and KV cache offloading with easy cloud deployment.
vLLM Production Stack provides a reference implementation on how to build an inference stack on top of vLLM, allowing for scalable, monitored, and performant LLM deployments using Kubernetes and Helm.
A user is seeking advice on deploying a new server with 4x H100 GPUs (320GB VRAM) for on-premise AI workloads. They are considering a Kubernetes-based deployment with RKE2, Nvidia GPU Operator, and tools like vLLM, llama.cpp, and Litellm. They are also exploring the option of GPU pass-through with a hypervisor. The post details their current infrastructure and asks for potential gotchas or best practices.
An in-depth look at Choreo, an open-source Internal Developer Platform (IDP) built on Kubernetes and GitOps, utilizing 20+ CNCF tools to provide a secure, scalable, and developer-friendly experience. The article discusses the challenges of Kubernetes management, the illusion of 'platformless' solutions, and how Choreo aims to bridge the gap between developer freedom and enterprise requirements.
EnterpriseDB's CloudNativePG, a Kubernetes operator for PostgreSQL, has been accepted into the CNCF sandbox, simplifying database management within Kubernetes environments by automating high availability and failover.
This skill path by Bryce Yu guides users through the basics of managing databases on Kubernetes using KubeBlocks. It covers installation, deployment, upgrades, backup, observability, and auto-tuning of database clusters.
